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(57) Abstract: File data for an operating system may be stored in a compressed format in a re -programmable semiconductor mem- 
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ACCESSING FILE DATA STORED IN NON- VOLATILE 
RE -PROGRAMMABLE SEMICONDUCTOR MEMORIES 

Background 

This invention relates generally to processor-based 
systems using semiconductor memory as their primary, non- 
volatile, re-programmable storage medium. 
5 There is increasing interest in so called embedded 

processor-based systems. These systems often operate with 
reduced functionalities to provide desired performance at 
relatively low cost. In many cases, these embedded systems 
may be battery operated. Thus, their capabilities may be 

10 limited to improve battery lifetime. 

For a variety of reasons including conserving battery 
life, reducing cost and providing a compact form factor, 
processor-based systems may be provided which do not use a 
hard disk drive as their non-volatile storage medium. In 

15 many processor-based system, a hard disk drive provides a 
convenient non-volatile storage medium that stores most of 
the information which the user desires to maintain 
permanently. This may include among other things, the 
operating system, application software, files and data, as 

20 examples. The information that is stored in the hard disk 
drive may be transferred for execution to system memory 
which conventionally is a volatile memory. 

In many systems, hard disk drives provide a very high 
capacity, relatively quick storage medium. However, hard 

25 disk drives take more space and use more power than non- 
volatile semiconductor memories. In many embedded systems, 
re-programmable, non-volatile semiconductor memories are 
used as a primary storage system for processor-based 
systems. These semiconductor memories store the panoply of 
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information normally stored in hard disk drives including 
operating systems . 

In many cases, the semiconductor memories utilized as 
primary non-volatile storage media for processor-based 
5 systems are flash memories. These flash memories may be re- 
programmed without user intervention using well known on- 
board capabilities. These memories are generally accessed 
using row and column addresses. Thus, the memories are 
generally monolithic in that the location of files and other 
10 data in that memory is generally stored outside the memory. 

Thus, there is a continuing need for a way to enable an 
operating system to store more information on a non-volatile 
re-programmable semiconductor memory and to access that 
information efficiently. 

15 Brief Description of the Drawings 

Figure 1 is a schematic depiction of the software 
modules utilized in accordance with one embodiment of the 
present invention; 

Figure 2 is a schematic depiction of the division of 
20 original uncompressed files into blocks in accordance with 
one embodiment of the present invention; 

Figure 3 is a schematic depiction of the allocation 
within a compressed file system image in accordance with one 
embodiment of the present invention; 
25 Figure 4 is a block diagram of one system for 

implementing an embodiment of the present invention; and 

Figure 5 is a flow chart for software which may be used 
in accordance with one embodiment of the present invention; 
Figure 6 is a flow chart for software that may be used 
30 in accordance with one embodiment of the invention; and 
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Figure 7 is a flow chart for software for compressing 
the blocks of information in accordance with one embodiment 
of the present invention. 

Detailed Description 
5 Referring to Figure 1, a client processor-based system 

may include a software architecture 10 having an operating 
system kernel 12 that communicates with a file system driver 
14. The file system driver 14 receives raw data from a 
semiconductor memory 40 and arranges that data in a logical 

10 layout. The driver 14 communicates with a buffer cache 16 
which buffers the raw data to enable it to be utilized 
effectively by the driver 14. The device driver 18 accesses 
blocks of file data from a non-volatile re-programmable 
semiconductor memory 40, such as a flash memory, in 

15 accordance with one embodiment of the present invention. 

The device driver 18, which need not have information about 
the format of the data on the memory 40, organizes the data 
in a format that is compatible with the file system driver 
14. 

20 Thus, the memory 40 may store a client operating system 

42 and a recovery operating system 44 which may be accessed 
if the client operating system fails. It may also store a 
basic input/output system (BIOS) 46 in accordance with one 
embodiment of the present invention. 

25 The client operating system 42 may include a cyclic 

recovery check (CRC) field 22, a field 24 that indicates the 
number of allocation table entries, a field 2 6 that includes 
the allocation table, a field 28 that includes a loader and 
a field 30 that includes the operating system kernel. The 

30 field 30 also includes the drivers 14 and 18. 

The client operating system 42 may also have one or 
more file system data storage areas 34, 36 and 38. These 

3 
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areas 34, 3 6 and 38 include raw compressed data that may be 
utilized by the operating system kernel 12. 

The device driver 18 may access any of the data areas 
34, 36 or 38 upon request from a file system driver 14. 
5 Thus, information may be accessed in the compressed format 
on the semiconductor memory 4 0 and loaded, in an 
uncompressed format, into the buffer cache 16 for access by 
the device driver 14. The device driver 18 decompresses the 
compressed data in memory 40 and provides it to the buffer 
10 cache 16. 

A compressed file system image may be created initially 
by forming a single binary file which contains the original 
uncompressed file system data in its raw form as indicated 
at 48 in Figure 2. The file containing the original 

15 uncompressed file system is then divided into a number of 
equally sized data blocks 50a-50c, The block size is the 
same for each compressed file system image and is set at 
build time in one embodiment of the invention. 

The uncompressed data is then compressed into variable 

20 length blocks 58 of compressed data and concatenated 

together as indicated in Figure 3. Thus, the uncompressed 
blocks 50a-50c are compressed to form compressed blocks 58a- 
58c of the compressed file system image 20. 

Each of the areas 34, 36 and 38 (Figure 1) includes an 

25 image having a header section (52-56) and a series of 

compressed blocks 58 which store the file system data, as 
shown in Figure 3 in one embodiment of the invention. The 
header section of the compressed file system image includes 
a field 52 with cyclic recovery check information. This 

30 field may have a zero offset and a length of two bytes. The 
cyclic recovery check value is calculated over the length of 
a block allocation table. The header also includes a field 
54 for the number of block allocation table entries. It has 
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an offset of two and a length of four bytes. The number of 
entries in the block allocation table may be stored as an 
unsigned, long value. The actual block allocation table 
(BAT) 56 has an offset of six and a length which is equal to 

5 the number of bat entries. The BAT 56 describes starting 
offsets and lengths for each compressed block 58. 

The device driver 18 uses the BAT 56 to find, in the 
semiconductor memory 40, the beginning and ending location 
of each of the compressed data blocks 58. The device driver 

0 18 operates by decompressing the compressed blocks of data 
in real time and mapping the decompressed data into the file 
system as requested by the operating system kernel 12 at run 
time. The device driver 18 may have no knowledge of the 
file system stored as the compressed file system image 20. 

5 Thus, in accordance with some embodiments of the 

present invention, an operating system may have access to 
compressed file system data stored on a semiconductor 
memory. Semiconductor memories may be less prone to 
electrical or mechanical failure than hard disk drives. In 

0 some embodiments of the present invention, the file system 
interfaces on the operating system may be utilized and 
leveraged by application level programs. Since the data 
stored in the semiconductor memory is compressed, less 
memory may be required, resulting in a less expensive 

5 solution. 

Any file system can be stored in the semiconductor 
memory independently of the nature of kernel's file system. 
Thus, the device driver 18 may be unaware of the file system 
stored within the semiconductor memory 40. In some 
0 embodiments of the present invention, additional files may 
be accessed by the client system 10 from a remote server 
(not shown) . The client may be a processor-based system 
such as a desktop computer system, a handheld computer 
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system, a processor-based television system, a set-top box, 
an appliance, a thin client, a cellular telephone or the 
like. In some embodiments, the system 10 may not be a 
network connected system. 
5 A storage device implementing the re-programmable 

semiconductor memory 40 may be electrically re-programmed. 
The storage device may also act as the BIOS memory for the 
client in one embodiment of the invention. While 
conventionally a BIOS memory is a read only memory (ROM) , by 
10 using a re-programmable memory 40 the operating system as 
well as the BIOS may be updated or replaced when corrupted . 
In other embodiments of the present invention, a 
conventional BIOS ROM may be used in addition to the memory 
40. 

15 A variety of flash memories may implement the memory 

40, such as Intel's StrataFlash™ brand memory. One 
advantageous memory is a 28F640J5 eight megabyte flash array 
available from Intel Corporation. This memory includes a 
plurality of one hundred twenty kilobyte blocks. Each block 

20 may be data protected so that it may not be erased or 
overwritten. In other words, data protection may be 
selectively applied to one or more of the plurality of 
blocks in the memory. 

A variety of operating systems may be utilized for the 

25 kernel 12 including Linux, Microsoft Windows® 98, Windows 
2000 or CE, and Be operating systems, as examples. The 
primary operating system may also be a real time operating 
system (RTOS) such as the Palm OS® Software 3.5 available 
from 3Com Corporation. 

30 The recovery operating system 44 operates in cases 

where the primary operating system 42 is corrupted or needs 
updating. The recovery operating system 44 may be an 
operating system of reduced size which includes basic, 
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essential functions and the limited software needed to 
obtain a new primary operating system. Thus, as used 
herein, a recovery operating system is an operating system 
that is responsible for updating and/or obtaining a 
5 replacement for a primary operating system. 

Ideally, the recovery operating system 44 may be 
stripped down as much as possible to conserve memory. If 
possible , its kernel may be reduced to only that code which 
is necessary to implement its recovery and update functions. 

10 One kernel that is particularly applicable is a Linux 

kernel. The Linux kernel includes an X-based kernel utility 
called MakeXConfig. This utility provides a graphical user 
interface to facilitate selecting the elements of the kernel 
and the operating system. That is, the Linux operating 

15 system allows the user to answer a series of questions, 

posed through a graphical user interface, indicating whether 
particular functionalities are desired. 

In the case of some system errors or crashes, the 
client system may reboot thereby resolving the error. If 

20 the number of reboots exceeds some threshold level, the 

recovery operating system may be invoked. When the system 
attempts to reboot, it may check a CMOS memory reboot count 
flag and then automatically reboot the recovery operating 
system if the reboot count threshold is exceeded. The 

25 recovery operating system 44 is started so that a new 

version of the primary operating system 42 may be fetched. 

The allocation table (AT) 26 partitions the memory 40 
and allows multiple code and data changes to be stored in 
the memory 40. This in turn allows multiple boot loaders to 

30 exist within the memory for booting different operating 

system images. At boot time, the BIOS 46 may select which 
boot loader to load and execute based on the status of a 
recovery bit. 
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A boot loader 28 for loading the primary operating 
system may be stored above the allocation table 26. Above 
the boot loader 28 is the kernel 30 or the core of the 
primary operating system 42. The primary operating system 
5 42 may be the same or different than the recovery operating 
system 44 . 

Above the kernel 30 is the file system. The allocation 
table 2 6 includes one entry for each item stored in the 
memory 40 including the items stored in the file system. 
10 The file system includes files, directories and information 
used to locate and access operating system files and 
directories - 

Each item contained in the allocation table 2 6 includes 
information about the software version, the flags, the data 

15 offsets, the length of the data and its load address. The 
version number may keep track of which version of software 
was loaded in a particular memory. The data offset 
determines where, in the memory 40, an entry is located. 
The flag field has information about the nature of the 

20 respective entries. The least significant bit of the flag 

field may include information about the status of the cyclic 
recovery check. This in effect tells the BIOS whether a CRC 
must be calculated. The next most significant bit includes 
the block type. The block type includes "boot" which 

25 indicates a boot loader, "kernel" or "file system". If the 
block type is boot loader, the flag field tells where, in 
random access memory, to load the boot loader out of the 
memory 40. A boot loader or boot strap loader loads and 
passes control to another loader program which loads an 

30 operating system. 

While the present invention may be used with a variety 
of processor-based systems, an application which uses a set- 
top box as the client system 60 is illustrated in Figure 4. 
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A set-top box works with a television receiver. The client 
60 may include a processor 65 coupled to an accelerated 
graphics port (AGP) chipset 66. The Accelerated Graphic 
Port Specification, Rev. 2.0 is available from Intel 
5 Corporation, Santa Clara, California. The chipset 66 may be 
coupled to system memory 68 in the accelerated graphics port 
bus 70. The bus 7 0 in turn may be coupled to a graphics 
accelerator 72 also coupled to a video or television 
receiver 73 . 

10 A portion 75 of system memory, called the CMOS memory, 

may be implemented by memory in integrated circuit which is 
adapted to save system data. Conventionally, the CMOS 
includes a real time clock which keeps the time. Recovery 
and update bits are stored in the CMOS memory in predefined 

15 locations . 

The chipset 66 may also be coupled to a bus 74 and 
receives a television tuner/capture card 76. The card 7 6 
may be coupled to a television antenna 78 which also may be 
a satellite or cable connection as additional examples. An 

20 interface to a network 16 such as a modem interface 

connection to the Internet or a network interface controller 
to a computer network may also be provided. 

A bridge 80 may in turn be coupled to another bus 84 
which supports a serial input/output interface 8 6 and a 

25 memory interface 94. The interface 8 6 may be coupled to a 
modem 8 8 or a keyboard 92. The interface 94 may couple the 
memory 40 storing the recovery operating system, BIOS, and 
primary operating system. The bridge 80 may be the 
82371ABPCI ISA IDE Xcelerator (PIIX4) chipset available from 

30 Intel Corporation. Thus, it may include a general purpose 
input/output pins (GP[I,0]). 

With a number of chipsets used to implement computer 
systems, the chipset may be set up so that it only sees a 
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certain number of lines of BIOS code at any one time. In 
embodiments in which the primary operating system and the 
recovery operating system are stored in flash memory, they 
may be accessed in the same way as BIOS memory is accessed. 
5 Thus, since the flash memory that is accessed is 

considerably larger than a BIOS memory, it may be desirable 
to allow other techniques to access all the data stored in 
the flash memory. One technique for doing this in 
processors from Intel Corporation is to use the GP[I,0] 

10 pins, for example, on the PIIX4 device. These pins can be 
coupled to the pins responsible for developing the signals 
for reading the BIOS. When providing the appropriate 
GP[I,0] signals, flash memory reading may be bank switched 
to sequentially read the entire memory. 

15 The system 60 may create the compressed file system 

image for storage on the memory. For example, the system 
may boot from another storage device, create the file system 
image and store that image on the memory 40. Alternatively, 
the image may be created and stored on the memory 4 0 by an 

20 external processor-based system. 

Referring now to Figure 5, in accordance with one 
embodiment, software 108 begins on power up or system reset 
with the BIOS executing and performing system initialization 
and power on self-test activities (block 110) . The contents 

25 of the memory 40 may be validated by checking the CRC stored 
in field 96 in the flash memory, as indicated in block 112. 
At this point, the BIOS selects the boot loader (block 114) 
to execute by scanning the allocation table and selecting an 
entry marked as a boot loader. The boot loader then uses 

30 the allocation table to find where in the flash memory the 
primary operating system is located (block 116) , loads the 
operating system at the appropriate address in system memory 
(block 118) and starts its execution (block 120) . 
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Referring to Figure 6, the device driver 18 may begin 
receiving a request for blocks of data as indicated in block 
124. The requested blocks are accessed from the storage as 
indicated in block 126. Each block is decompressed and 
5 indicated in block 128. The data is then returned to the 
file system module as indicated in block 130. 

The software 132 for compressing the file system image, 
shown in Figure 7, begins by dividing the file system image 
into blocks 50 of equal size as indicated at 134. The data 

10 is compressed and formed into blocks 50 that are of variable 
length and concatenated as indicated at 136. The number of 
entries is determined (block 138) as well as the CRC (block 
140) and the BAT (block 142). 

While the present invention has been described with 

15 respect to a limited number of embodiments, those skilled in 
the art will appreciate numerous modifications and 
variations therefrom. It is intended that the appended 
claims cover all such modifications and variations as fall 
within the true spirit and scope of this present invention. 

20 What is claimed is: 
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1. A method comprising: 

receiving a request from an operating system for 
file data; and 

accessing a semiconductor memory storing 
5 compressed file data. 

2. The method of claim 1 further including 
decompressing said compressed file data. 

3. The method of claim 2 including using a device 
driver to format the decompressed data in a format 

10 compatible with a file system utilized by said operating 
system. 

4. The method of claim 3 including storing the 
decompressed data in a buffer for use by a file system 
driver . 

15 5. The method of claim 1 including forming a file 

system image of blocks of data of substantially equal size. 

6, The method of claim 5 including compressing each 
of said blocks to form a compressed file system image formed 
of blocks of unequal size. 

2 0 7. The method of claim 6 including affixing a header 

to said file system image which provides information about 
how to locate each block. 

8. The method of claim 7 including providing in said 
header information about the number of entries in an 
25 allocation table and providing in said allocation table 
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information about the length of each of said compressed 
blocks in said file system image. 

9. The method of claim 1 including accessing an 
operating system stored in said semiconductor memory. 

10. An article comprising a medium storing 
instructions that cause a processor-based system to: 

receive a request from an operating system for 
file data; and 

access a semiconductor memory storing compressed 

file data. 

11. The article of claim 10 further storing 
instructions that cause a processor-based system to 
decompress said compressed file data. 

12. The article of claim 11 further storing 
instructions that cause a processor-based system to use a 
device driver to format the de-compressed data in a format 
compatible with a file system utilized by said operating 
system. 

13. The article of claim 12 further storing 
instructions that cause a processor-based system to store 
the de-compressed data in a buffer for use by a file system 
driver. 

14. The article of claim 10 further storing instruc- 
tions that cause a processor-based system to form a file 
system image of blocks of data of substantially equal size. 
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15. The article of claim 14 further storing 
instructions that cause a processor-based system to compress 
each of said blocks to form a compressed file system image 
formed of blocks of unequal size. 

3 16. The article of claim 15 further storing 

instructions that cause a processor-based system to affix a 
header to said file system image which provides information 
about how to locate each block. 

17. The article of claim 16 further storing 

3 instructions that cause a processor-based system to provide 
in a header a block allocation table including information 
about the length of each of said compressed blocks in said 
file system image. 

18. The article of claim 17 further storing 

5 instructions that cause a processor-based system to provide 
in said header information about the number of entries in 
said allocation table. 

19. The article of claim 10 further storing 
instructions that cause a processor-based system to access 

0 an operating system stored in said semiconductor memory. 

20. A system comprising: 
a processor; and 

a re-programmable semiconductor memory coupled to 
said processor, said memory storing a compressed operating 
5 system and compressed file data for said operating system. 

21. The system of claim 20 wherein said memory is a 
flash memory. 

14 
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22. The system of claim 21 including a basic 
input/output system stored in a compressed format on said 
memory. 

23. The system of claim 22 including, stored on said 
5 memory, a primary operating system and a backup operating 

system for use when the primary operating system fails to 
needs updating. 

24. The system of claim 20 including a device driver 
which decompresses said compressed data in said memory and 

10 provides said data in a format used by the operating system. 

25. The system of claim 24 including a file system 
driver which organizes the data received from said device 
driver into a file system. 

26. The system of claim 20 wherein said semiconductor 
15 memory stores an allocation table which indicates the length 

of entries stored in said memory and the number of entries 
in said allocation table. 

27. The system of claim 20 wherein said file system 
data stored in compressed form on said semiconductor memory 

20 is formed into compressed blocks of unequal length. 

23. The system of claim 20 including data for more 
than one file system stored on said semiconductor memory. 

29. The system of claim 27 including a loader and a 
kernel for an operating system stored on said memory. 
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30. The system of claim 20 including a network 
connection to download additional data from said network. 
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